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( START ) 
IDENTIFY PATH 

I 

DETERMINE GRAPHICS GUIDE THAT PROVIDES SUBSTANTIALLY 
UNOBSTRUCTED VIEW OF INSTRUMENT DURING POSITIONING 



I 



■710 



•720 



CONSTRUCT GRAPHICS GUIDE TO FRAME PATH 
(WITH A WINDOW FOR STEPS 730a-b, AN OPENING FOR STEP 730c 
ORAPATTERN OF LINES FOR STEP730d) 



730a 

A. 



CONSTRUCT POLYGON THAT 
HAS 2 OPPOSING ENDS 
AND WINDOW FROM ONE 
END TO THE OTHER 



730b 

A. 



£ 



I 



■730 



CONSTRUCT PARTIAL CYLINDER 
THAT HAS FIRST AND SECOND 
ENDS AND WINDOW FROM 
FIRST TO SECOND END 



730c 
± 



CONSTRUCT CIRCLE WITH 
OPENING (TO RESEMBLE 

LETTER C) LARGER THAN THE 
WIDTH OF THE MEMBER 



730d 

A 



CONSTRUCT PATTERN OF LINES SPACED 
TO ALLOW MEMBER TO PASS THROUGH 
AT LEAST 2 CONSECUTIVE LINES (OF 
OPTIONALLY DIFFERENT SPACING OR 
LENGTH WITH RESPECT TO OTHER LINES) 

I 



TRACK OBSERVERAND/OR INSTRUMENT, RENDER GRAPHICS GUIDE E.G., SOLID, SEMI-TRANSPARENT, 
TEXTURED, OUTLINED, OR COMBINATION THEREOF) IN ALIGNMENT WITH THE PATH INCLUDING ORIENTING GUIDE 
WITH RESPECT TO OBSERVER, AND OPTIONALLY RENDER REPRESENTATION OF THE INSTRUMENT 



750a 

A 



750b 



ORIENT POLYGON 
TO HAVE 
CENTERLINE 
OF WINDOW 
ALIGNED WITH 
THE PATH 



750c1 



ORIENT PARTIAL 
CYLINDER TO 
HAVE LENGTH- 
WISE AXIS 
ALIGNED WITH 
THE PATH 



760ab- 



1 



A 



ORIENT CIRCLE TO 
SUBSTANTIALLY ENCLOSE 
TARGET LOCATION, WITH 
OPENING TO THE RIGHT FOR 
RIGHT-HANDED OBSERVER 
AND TO THE LEFT FOR LEFT- 
HANDED OBSERVER 



760c 



DYNAMICALLY 
ADJUST/RE-ADJUST 
ORIENTATION OF WINDOW 
RELATIVE TO VANTAGE 
POINT OF OBSERVER 



1 



750c2 



ORIENT CIRCLE TO 
SUBSTANTIALLY 
ENCLOSE TARGET 
LOCATION, WITH 
OPENING ENCLOSING 
AN AXIS OF THE PATH 



■735, 740, 
750 



750d 

A 



ORIENT PATTERN TO 
SURROUND TARGET 
LOCATION AND WITH 
THE AT LEAST TWO 
CONSECUTIVE LINES 
FRAMING THE PATH 



DYNAMICALLY 
ADJUST/RE-ADJUST 
ORIENTATION OF OPENING 
RELATIVE TO VANTAGE 
POINT OF OBSERVER 



I 



DYNAMICALLY ADJUST/RE-ADJUST 

ORIENTATION OF PATTERN 
OF LINES RELATIVE TO VANTAGE 
POINT OF OBSERVER 



■760d 



(END) 

FIG. 7 
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( START ) 

DEFINE A POINT ON AN ACTUAL TARGET AND AN ACTUAL PATH TO REACH THE POINT ON THE ACTUAL TARGET 

I 

TRACKAPOSE OF AN INSTRUMENT WITH RESPECT TO A POSE OF THE ACTUAL TARGET 

I 

CHOOSE AN ORIENTATION OF THE GRAPHICAL REPRESENTATION AROUND THE VIRTUAL LINE OF 
SIGHT ACCORDING TO A POSE OF A USER WITH RESPECT TO THE ACTUAL TARGET 

DETERMINE (BASED ON A SELECTION) THE ORIENTATION SUCH THAT EAST, WEST, 
NORTH, AND SOUTH CORRESPOND TO RIGHT, LEFT, FORWARD, AND BACKWARD, 
RESPECTIVELY, FOR THE POSE OF THE USER WHERE USER FACES THE ACTUAL TARGET 

DYNAMICALLY ADJUST THE ORIENTATION ACCORDING TO A CHANGE OF THE POSE OF THE USER 
DYNAMICALLY ADJUST THE SELECTION WITH RESPECT TO THE POSE OF THE USER 



■2302 



■2304 



•2306 



•2306a 



■2306b 



•2306c 



I 



RENDER AGRAPHICAL REPRESENTATION OF THEACTUAL INSTRUMENT AND THE ACTUAL TARGET TO 
OBTAIN A VIRTUAL INSTRUMENT AND AVIRTUAL TARGET POINT, RESPECTIVELY, THE GRAPHICAL 
REPRESENTATION BEING RENDERED WITH RESPECT TO AVIRTUAL VIEWPOINT FROM WHICH A 
VIRTUAL LINE OF SIGHT TO THE VIRTUAL TARGET POINT COINCIDES WITH AVIRTUAL PATH OR THE 
VIRTUAL INSTRUMENTTO FOLLOW DURING A POSITIONING OF THEACTUAL INSTRUMENT TO THE 
POINT ON THE ACTUAL TARGET, THE VIRTUAL PATH CORRESPONDING TO THE REAL PATH 



■2308 



I 



RENDER GRAPHICAL INFORMATION ABOUT A DISTANCE BETWEEN THE ACTUAL INSTRUMENT AND 
THE POINT ON THE ACTUAL TARGET (OPTIONALLY, ACCORDING TO A VIRTUAL CAMERA WITH A WIDE ANGLE LENS 



I 



OVERLAY THE GRAPHICAL INFORMATION ABOUTTHE DISTANCE ONTO THE GRAPHICAL REPRESENTATION 



I 



COMBINE THE GRAPHICAL REPRESENTATION FROM THE VIRTUAL VIEWPOINT WITH ANOTHER 
GRAPHICAL REPRESENTATION FROM ANOTHER VIRTUAL VIEWPOINT LOOKING AT THE VIRTUAL PATH FROM THE SIDE 



I 



COMBINE THE GRAPHICAL REPRESENTATION FROM THE VIRTUAL VIEWPOINT WITH AN AUGMENTED REALITY VIEW 



I 



ALIGN THE VIRTUAL INSTRUMENT ALONG THE VIRTUAL LINE OF SIGHT TO THE VIRTUAL TARGET POINT TO 
ALIGN THE ACTUAL INSTRUMENT ALONG THE ACTUAL PATH 



I 



MOVE THE ACTUAL INSTRUMENT ALONG THE ACTUAL PATH TOWARDS THE POINT ON THE ACTUAL TARGET 



■2310 



■2312 



■2314 



■2316 



•2318 



■2320 



FIG. 23 C?D 



